Appl. No. 09/521,252 PATENT 

Amdt. sent September 23, 2005 

Amendment under 37 CFR 1.116 Expedited Procedure 

Examining Group 2176 



Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 



Listing of Claims: 



1 1 . (Currently amended): A computer executable method for managing 

2 information during a meeting comprising steps of: 

3 recording activities among participants during said meeting to produce recorded 

4 meeting data; 

5 analyzing said recorded meeting data absent direct human intervention to identify 

6 one or more cues contained in said recorded meeting data while said meeting is ongoing, said 

7 cues indicative of a participant directive representing an action on said information desired by a 

8 participant of said meeting; and 

9 in response to identifying said participant directive, performing said action 

1 0 represented by said participant directive, 

1 1 thereby facilitating the management of information during said meeting. 

1 2. (Original): The method of claim 1 wherein said identifying a participant 

2 directive includes producing textual information from said recorded meeting data and analyzing 

3 said textual information. 

1 3. (Original): The method of claim 2 wherein said recorded meeting data 

2 includes video recordings and audio recordings. 

1 4, (Original): The method of claim 1 wherein said action includes an activity 

2 selected from the group consisting of: document management activities, document editing 

3 activities, messaging functions, establishing communication with a new meeting participant, and 

4 manipulation of said recorded meeting data. 
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1 5. (Original): The method of claim 4 wherein said document management 

2 activity includes accessing said recorded meeting data during said meeting. 

. 1 6. (Original): The method of claim 1 wherein said activities include verbal 

2 communication, written communication, presentation of prepared material using a projection 

3 system. 

1 7. (Original): The method of claim 1 further including ascertaining identities 

2 of said participants and selectively effectuating said participant directive based on said identities. 

1 8. (Original): The method of claim 1 further including tracking locations of 

2 said participants and selectively effectuating said participant directive based on said locations. 

1 9. (Original): The method of claim 1 further including locating said 

2 participants in different geographic locations. 

1 10. (Currently amended): A computer executable method for providing 

2 information services during a meeting involving two or more participants comprising steps of: 

3 producing a continuous video recording of at least one of said participants for the 

4 duration of said meeting; 

5 producing a continuous audio recording of at least one of said participants for the 

6 duration of said meeting; 

7 storing said video and said audio recordings in a data store; 

8 analyzing either or both of said video recording or said audio recording to identify 

9 cues contained therein to detect a participant directive , absent direct human intervention : and 

10 providing one or more information-related services based on said participant 

11 directive, 

12 thereby providing information-related services based on gestures and vocal 

13 utterances made by said participants during said meeting. 
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1 11. (Original): The method of claim 10 wherein said detecting a participant 

2 directive includes receiving participant input from an input device. 

1 12. (Original): The method of claim 10 wherein said detecting a participant 

2 directive includes analyzing textual information contained in either or both of said audio and 

3 video recordings. 

1 13. (Original): The method apparatus system of claim 10 wherein said 

2 detecting a participant directive is based on the context of the meeting. 

1 14. (Original): The method of claim 10 wherein said detecting a participant 

2 directive includes detecting an information retrieval cue, said method further including; 

3 producing certain information based on said information retrieval cue, including accessing said 

4 data store to retrieve one or more segments of said video and said audio recordings and accessing 

5 one or more databases to retrieve information contained therein; and presenting said certain 

6 information to one or more of said participants. 

1 15. (Original): The method of claim 14 wherein said detecting an information 

2 retrieval cue includes receiving participant input from an input device. 

1 16. (Original): The method of claim 14 wherein said presenting certain 

2 information is a step of presenting said certain information to less than all of said participants. 

1 17. (Original): The method of claim 14 further including tracking locations of 

2 said participants, wherein said presenting said certain information is a step of selectively 

3 presenting said certain information based on said locations. 

1 18. (Original): The method of claim 10 wherein said information services 

2 include accessing information, editing information, assimilating information to produce new 

3 information, establishing communication with a new participant, transmitting and receiving 

4 messages, accessing a global information network, and accessing a local network. 
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1 19. (Original): The method of claim 18 wherein said messages include 

2 electronic mail. 

1 20. (Original): The method of claim 10 wherein provision of said information 

2 services depends on permissions associated with said participants. 

1 21. (Original): The method of claim 20 further including identifying said 

2 participants to determine associated permissions. 

1 22. (Original): The method of claim 10 further including locating said 

2 participants in geographically distinct locations. 

1 23. (Currently amended): A system for providing information services during 

2 an interaction between two or more participants, comprising: 

3 a video capture component configured to produce a continuous video recording of 

4 at least one of said participants; 

5 an audio capture component configured to produce a continuous audio recording 

6 of at least one of said participants; 

7 a data storage component containing information, said data storage component in 

8 communication with said video and audio capture components and configured to store said video 

9 and audio recordings; 

10 a detection component in communication with said video and audio capture 

1 1 components and configured to analyze either or both of said video recordings or said audio 

12 recording to th e reby identify a participant directive , absent direct human intervention ; and 

13 a service provision component in communication with said data storage 

14 component and configured to provide an information service based on said participant directive, 

15 thereby providing information services during said interaction based on gestures 

1 6 and vocal utterances made by said participants. 
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1 24. (Original): The system of claim 23 wherein said participant directive is an 

2 information retrieval cue, and wherein said service provision component is further configured to 

3 retrieve certain information from said data storage component in response to said information 

4 retrieval cue and to provide said certain information to said display component. 

1 25. (Original): The system of claim 24 wherein said certain information 

2 includes said continuous video recording and said continuous audio recording. 

1 26. (Original): The system of claim 23 further including a user input portion 

2 configured to receive user-provided input data, said detection component further configured to 

3 identify a participant directive from said user-provided input data. 

1 27. (Original): The system of claim 23 further including a participant 

2 identification component, said service provision component being further configured to 

3 selectively provide said information service based on identities of one or more of said 

4 participants. 

1 28. (Original): The system of claim 27 wherein said identities have associated 

2 permissions, said service provision component being further configured to selectively provide 

3 said information service based on said permissions. 

1 29. (Original): The system of claim 27 wherein said participant identification 

2 component is configured to provide participant locations, said service provision component 

3 being further configured to selectively provide said information service based on said participant 

4 locations. 

1 30. (Original): The system of claim 23 wherein said information service 

2 includes providing access functions over a communication network. 

1 31. (Original): The system of claim 30 wherein said information service 

2 includes data retrieval from a global communication network. 
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1 32. (Original): The system of claim 30 wherein said information service 

2 includes data retrieval from a plurality of web sites. 

1 33. (Currently amended): A computer executable method of utilizing plural 

2 information sources to enhance information management during a meeting between two or more 

3 attendees, comprising: 

4 producing and storing a continuous audio- visual recording of one or more of said 

5 attendees, said audio-visual recording comprising a video data component and an audio data 

6 component; 

7 extracting and storing textual information from said audio and video data 

8 components; 

9 extracting and storing image information from said video data component; 

10 analyzing said textual information or said image information to detect , absent 

1 1 direct human intervention, attendee action cues from said audio data component or said video 

12 data component; 

13 accessing certain information from said information sources based on said 

14 attendee action cues; and 

1 5 presenting said certain information, 

16 thereby providing information services during said meeting on the basis of the 

1 7 actions of said attendees. 

1 34. (Original): The method of claim 33 wherein said accessing certain 

2 information includes searching through said audio-visual recording. 

1 35. (Original): The method of claim 33 wherein said detecting attendee action 

2 cues includes receiving explicit commands from an attendee. 

1 36. (Original): The method of claim 33 further including tracking locations of 

2 said attendees, said presenting certain information being based on said locations. 
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1 37. (Original): The method of claim 33 further including editing information 

2 in said information sources based on said attendee action cues; and producing new information 

3 by assimilating portions of information in said information sources based on said attendee action 

4 cues. 

1 38. (Original): The method of claim 33 further includes identifying said 

2 attendees from said audio and video data components to produce attendee identifiers. 

1 39. (Original): The method of claim 38 further including manipulating 

2 information in said information sources based on said attendee action cues and said attendee 

3 identifiers. 

1 40. (Original): The method of claim 39 wherein said manipulating 

2 information includes editing said information. 

1 41 . (Original): The method of claim 33 further including locating said 

. 2 attendees in different parts of the world. 

1 42. (Currently amended): A system to facilitate the management of 

2 information during a meeting between two or more attendees, comprising: 

3 an information storage portion configured to receive and store information and to 

4 access and provide information; 

5 an audio-visual capture portion in communication with said information storage 

6 portion and configured to produce real-time video recordings and real-time audio recordings of 

7 one or more of said attendees; 

8 a text classification portion in communication with said information storage 

9 portion and configured to produce and store textual information extracted from said audio and 

10 video recordings; 

11 an image classification portion in communication with said information storage 

12 portion and configured to produce and store image information in said video recordings; 
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13 a cue detection portion configured to detect attendee action cues from said textual 

1 4 information during said meetin g, absent direct human intervention : 

15 an information retrieval portion in communication with said information storage 

16 portion and configured to access information therefrom based on said attendee action cues; ^ 

17 an information manipulation portion in commimication with said information 

1 8 storage portion and configured to manipulate information stored therein based on said attendee 

19 action cues; and 

20 an information presentation portion operatively coupled to said information 

21 retrieval portion and said information manipulation portion and configured to display retrieved 

22 and manipulated information, 

23 wherein information including said textual information and said image 

24 information can be retrieved and manipulated by gestures and voice input of said attendees 

25 during said meeting. 

1 43. (Original): The system of claim 42 fiirther including an attendee 

2 identification portion coupled to said information storage portion and configured to identify said 

3 attendees from said audio and video recordings and to provide attendee identifiers. 

1 44. (Original): The system of claim 43 wherein said information presentation 

2 portion is further configured to selectively display said retrieved and manipulated information to 

3 attendees depending on said attendee identifiers. 

1 45. (Original): The system of claim 42 wherein said attendee action cues 

2 include directives to access said video and audio recordings of said meeting. 

1 46. (Original): The system of claim 42 wherein said cue detection portion is 

2 fiirther configured to detect said attendee action cues on the basis of the context of said meeting. 

1 47. (Original): The system of claim 42 fiirther including an attendee tracking 

2 portion configured to track movements and locations of said attendees. 
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1 48. (Original): The system of claim 47 wherein said information presentation 

2 portioii is further configured to selectively display said retrieved and manipulated information to 

3 attendees depending on said attendee identifiers, said attendee cues, arid said locations of 

4 attendees. 

1 49. (Original); The system of claim 47 wherein said attendee identification 

2 portion includes creating new identifiers for unknown attendees. 
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